Multi-View Hidden Markov Perceptrons
نویسندگان
چکیده
Discriminative learning techniques for sequential data have proven to be more effective than generative models for named entity recognition, information extraction, and other tasks of discrimination. However, semi-supervised learning mechanisms that utilize inexpensive unlabeled sequences in addition to few labeled sequences – such as the Baum-Welch algorithm – are available only for generative models. The multi-view approach is based on the principle of maximizing the consensus among multiple independent hypotheses; we develop this principle into a semisupervised hidden Markov perceptron algorithm. Experiments reveal that the resulting procedure utilizes unlabeled data effectively and discriminates more accurately than its purely supervised counterparts.
منابع مشابه
A speech recognition method based on the sequential multi-layer perceptrons
-A no vel multi-layer perceptrons ( MLP)-based speech recognition method is proposed in this study. In this method, the dynamic time warping capability o f hidden Markov models ( H M M ) is directly combined with the discriminant based learning of M L P for the sake o f employing a sequence of MLPs (SMLP) as a word recognizer. Each M L P is regarded as a state recognizer to distinguish an acous...
متن کاملNon-linear Analysis of Shocks when Financial Markets are Subject to Changes in Regime
Violent turbulences are often striking the financial markets and an Index of Market Shocks (IMS) was recently introduced in the attempt of quantifying these turbulences. Regime switching linear models have already been used in modelling the conditional volatility of returns. In this paper we propose a description of the IMS with hybrid models integrating multi-layer perceptrons and hidden Marko...
متن کاملSpectral Entropy Feature in Multi-Stream for Robust ASR
In recent papers, entropy computed from sub-bands of the spectrum was used as a feature for automatic speech recognition. In the present paper, we further study the sub-band spectral entropy features which can give the flatness/peakiness of the sub-band spectrum and in turn the position of the formants in the spectrum. The sub-band spectral entropy features are used in hybrid hidden Markov mode...
متن کاملHybrid Schemes of Homogeneous and Heterogeneous Classifiers for Cursive Word Recognition
Sophisticated hybrid schemes of the homogeneous and heterogeneous classifiers for cursive word recognition are presented. Two homogeneous MLPs (multi-layer perceptrons) are combined into a new single powerful classifier at the architectural level, and HMM (hidden Markov model) is added to the new classifier as a heterogeneous one at the output level. This is based on the idea that classifiers w...
متن کاملEstimating the Number of Components in a Mixture of Multilayer Perceptrons
BIC criterion is widely used by the neural-network community for model selection tasks, although its convergence properties are not always theoretically established. In this paper we will focus on estimating the number of components in a mixture of multilayer perceptrons and proving the convergence of the BIC criterion in this frame. The penalized marginal-likelihood for mixture models and hidd...
متن کامل